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1 Field Of The Invention 

2 The invention relates generally to the field of digital communications, and more particularly 

3 to systems and methods for facilitating recovery from communication link failures in a digital data 

4 network. 

5 Background Of The Invention 

^ ; 6 Digital networks have been developed to facilitate the transfer of information, including data 

^ 7 and programs, among digital computer systems and numerous other types of devices. A variety of 

y= 8 types of networks have been developed and implemented using diverse information transfer 

9 methodologies. In modern networks, information is transferred through a mesh of switching nodes 

Hi 0 which are interconnected by communication links in a variety of patterns. The mesh interconnection 

s 1 1 pattern can allow for a number of paths to be available through the network from each computer 

si 2 system or other device which may transmit information as a source device, to another computer 

03 system or other device, which is to receive the information as a destination device, so that if 

-4J14 congestion develops in particular regions of the network, or if components of the network become 

1 5 inoperative, information can be routed around the congested or inoperative portion of the network. 

1 6 Information transferred from a source device to a destination device is generally transferred 

17 in the form of fixed- or variable-length packets, which are received by a switching node over a 

1 8 communication link connected thereto, and transmitted over another communication link to facilitate 

19 transfer of the packet to the destination device or another switching node along a path to the 

20 destination device. Each packet typically includes address information, including a source address 

2 1 that identifies the particular device that generated the packet, and a destination address that identifies 

22 the particular device or devices to receive the packet. 

23 Information transferred from a source device to a destination device is generally transferred 
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1 in the form of fixed- or variable-length packets, which are transferred through the network in 

2 accordance with one of several general packet transfer methodologies. In one packet transfer 

3 methodology, termed a "connectionless" data transfer methodology, each information packet that 

4 is transmitted by a source device to a destination device includes, in addition to the information to 

5 be transferred, destination address information which identifies the particular device that is to receive 

6 the packet. Each switching node in the network is provided with a database that stores network 

7 topology information, which describes the entire topology of the network, and a routing table that 

8 provides, among other information, routing information identifying the path to be taken from the 

9 switching node to any other switching node in the network. When a switching node receives a 
r i 0 packet that is to be transferred to a particular destination device, it (that is, the switching node) will 
M 1 use the routing table to identify a communication link over which the packet is to be transmitted. 

yl2 In another "connection-oriented" packet transfer methodology, packets are transferred 

~3 3 through the network's switching nodes over constructs which are generally termed "virtual circuits," 

^14 "virtual connections," "switched paths," and the like (generally, "virtual circuits"). When a source 

Q 5 device wishes to transfer information to a destination device, initially a preliminary operation will 

lJ 6 be performed to establish a virtual circuit over communication links defining a path from the source 

y 7 device, through one or more switching nodes to the destination device. In this methodology, each 

S3 8 switching node that operates using the virtual circuit methodology includes a virtual circuit table that 

19 identifies, for each virtual circuit for which the switching node forms a path, the particular 

20 communication link over which the packet is to be transmitted. In addition, each switching node 

2 1 may also include a network topology database that stores network topology information, which may 

22 be used for transferring connectionless packets which may be used for a variety of purposes, 

23 including, for example, transferring network management information to respective switching nodes. 

24 Several problems can arise if a communication link interconnecting two switching nodes fails 

25 or otherwise malfunctions. When that occurs, typically some time is required to provide information 

26 to all of the switching nodes in the network indicating that the communication link is no longer 
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1 available. For some time after the failure or malfunction occurs, the network topology information 

2 as maintained by the various switching nodes will be inconsistent, in which case their routing 

3 determinations, or virtual circuit path establishment decisions will also be inconsistent. In addition, 

4 in a connection-oriented network, switching nodes may attempt to establish virtual circuits over the 

5 failed communication link. A number of undesirable consequences can arise if switching nodes in 

6 a network have inconsistent or incorrect routing information. For example, in a connectionless 

7 network, inconsistent or incorrect routing information can result in looping packets among a plurality 

8 of switching nodes in the network, loss of packets, as well as routing of packets over paths in the 

9 network which are not optimal. In a connection oriented network, inconsistent or incorrect routing 
, J 0 information can result in inability to set up new virtual circuits and inability to repair virtual circuits 
CI 1 which have failed. 

B 2 Summary Of The Invention 

L.1 3 The invention provides a new and improved system and method for facilitating recovery from 

N&4 failures of communication links in a digital data network. 

5 In brief summary , the invention provides anetwork comprising a plurality of switching nodes 

^1 6 interconnected by communication links for transferring digital packets. At least one switching node 

1 7 in the network pre-establishes a bypass virtual circuit through the network to bypass an element of 

1 8 the network, such as a switching node or a communication link, in the network. The bypass virtual 

1 9 circuit defines a path to another switching node in the network. The first switching node uses the 

20 bypass virtual circuit so constructed in forwarding of a packet in the event of a failure or other 

21 malfunction of the element if the first switching node would otherwise transfer the packet over that 

22 element. By providing and making use of such bypass virtual circuits, the switching nodes which 

23 are connected to an element which has failed or otherwise malfunctioned can avoid notifying the 

24 other switching nodes, thereby avoiding undesirable consequences that can occur if the routing 

25 information maintained by the switching nodes is inconsistent. 
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1 Brief Description Of The Drawings 

2 This invention is pointed out with particularity in the appended claims. The above and 

3 further advantages of this invention may be better understood by referring to the following 

4 description taken in conjunction with the accompanying drawings, in which: 

5 FIG. 1 schematically depicts a computer network including a facility for recovering from 

6 communication link failures, constructed in accordance with the invention; 

_ 7 FIG. 2 is a flowchart depicting operations performed by switching nodes in connection with 

%0 8 recovering from communication link failures. 

^: 9 Detailed Description of an Illustrative Embodiment 

1 0 FIG. 1 schematically depicts a computer network 1 0 including a facility for recovering from 

sA 1 communication link failures constructed in accordance with the invention. The computer network 

Q2 10 includes a plurality of switching nodes 1 1(1) through 1 1(N) (generally identified by reference 

Si 3 numeral 1 1 (n)) for transferring signals representing data among a number of devices, which in FIG. 

14 1 are represented by packet source/destination devices 12(1) through 1 2(M) (generally identified by 

1 5 reference numeral 1 2(m)) in a wide area network ("WAN"). The switching nodes 1 1 (n) used in one 

16 embodiment of the invention may be similar to the switching node described in U. S. Patent 

17 Application Ser. No. , filed July 2, 1998, in the names of Steven J. 

1 8 Schwartz, et al., entitled "System And Method For Switching Packets In A Network" (Atty. Docket 

19 No. IRB-001), assigned to the assignee of the present application and incorporated herein by 

20 reference. The packet source/destination devices 12(m), as is conventional, include a particular 

2 1 device, such as a computer system or other device that stores, generates, processes or otherwise uses 

22 digital data, a local area network of such devices, or the like (not separately shown) to the wide area 

23 network 1 0. Each packet source/destination device 12(m) is connected over a communication link, 
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1 generally identified by reference numeral 1 3(p), to a switching node 1 1 (n) to facilitate transmission 

2 of data thereto or the reception of data therefrom. The switching nodes 1 1 (n) are interconnected by 

3 communication links, also generally identified by reference numeral 13(p) to facilitate the transfer 

4 of information among the respective switching nodes 1 l(n). The communication links 13(p) may 

5 utilize any convenient information transmission medium, including, for example, wires for carrying 

6 electrical signals, optical fiber links for carrying optical signals, and so forth. Each communication 

7 link 13(p) is preferably bi-directional, allowing the switching nodes 1 l(n) to transmit and receive 

8 signals among each other and with customer premises equipment 12(m) connected thereto over the 

9 same link; depending on the particular type of medium selected for respective communication links 
^40 13(p), multiple media may be provided for transferring signals in opposite directions thereby to 
JJfl 1 provide the bidirectional link. In addition, each communication link 13(p) depicted in FIG. 1 may 
Hi 2 comprise a plurality of physical uni- or bi-directional links to provide redundancy in the event of a 
jrf 3 failure in one of the links or transmitting or receiving circuitry associated therewith. 

^14 Data is transferred in the network 10 in the form of packets. Generally, a packet includes a 

Dl 5 header portion and a data portion. The header portion includes information that assists in routing 

y!6 the packet through the network, with the specific information depending on the particular packet 

7 routing protocol that is used in routing packets through the network. In connection with network 1 0, 

ffll 8 any of a number of well-known packet routing protocols may be used. In one embodiment, which 

1 9 will be described in connection with FIG. 2, a connectionless routing protocol is used, in particular, 

20 the well-known Internet protocol ("IP"). A second embodiment, in which a connection-oriented 

21 routing protocol, in which packets are transferred over virtual circuits, will further be described. 

22 In the connectionless routing protocol, the header portion typically includes address information 

23 including a source address identifying the particular source device 1 2(mS) that generated the packet 

24 and a destination address identifying the particular destination device 12(mD) that is to receive the 

25 packet. In the IP protocol, a packet may be of variable length and the header typically will also 

26 include length information to identify the length of the packet. The header also typically includes 

27 other information, including, for example, protocol identifier information that identifies the 
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1 particular protocol that defines the structure of the packet. The data portion contains the data 

2 payload of the packet. The packet may also include, as part of the header portion, data portion or 

3 otherwise, error detection information that can be used to determine whether an error occurred in 

4 transferring the packet. 

5 A source device 12(mS), after generating a packet for transfer to a destination device 

6 1 2(mD), will provide the packet to the switching node 1 1 (n) connected thereto. The switching node 

7 1 1 (n) will use the destination address in the packet to attempt to identify a "route," which associates 

8 a destination address with one of the communication links 1 3(p) connected thereto over which it is 

9 to transfer the packet to forward it (that is, the packet) to either the destination device 1 2(mD), if the 
^10 switching node 1 l(n) is connected to the destination device 12(mD), or to another switching node 
f*ll 11 (n 1 ) (nVn) along a path to the destination device 12(mD). Each switching node maintains a 
yjl 2 network topology database, which identifies the switching nodes 1 1 (n) comprising the network, the 
yhil 3 communication links 1 3(p) which interconnect them, and other information such as communications 
r 1 4 "cost" information associated with each communication link 1 3(p), which they (that is, the switching 
015 nodes ll(n)) use to determine the route information. Several methodologies are known for 
u 1 6 generating route information from network topology information in the network topology database, 
~1 7 including the well-known OSPF ("open shortest path first") methodology. If the switching node can 
C018 identify a route for the received packet, it will forward the packet over the communication link 

19 identified by the route. Each switching node ll(n'), ll(n"),..., which receives the packet will 

20 perform a similar operation. If all of the switching nodes have respective routes for the destination 

21 address, the packet will eventually arrive at the destination device 12(mD). 

22 The invention provides an arrangement, which will be described in connection with the 

23 network 10 depicted in FIG. 1, for facilitating recovering from failures or other malfunctions in 

24 connection with a communication link 13(p) interconnecting two switching nodes ll(n). A 

25 switching node 1 l(n) and a device 12(m) may determine that a failure or other malfunction has 

26 occurred using any of a number of conventional arrangements. For example, elements connected 

27 to a particular communication link 1 3(p) can verify that it has not failed or otherwise malfunctioned 
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1 by, for example, periodically transferring link status packets thereover, particularly if other packets 

2 are not being transferred thereover. In that case, if a switching node 1 1 (n) or device 1 2(m) does not 

3 receive a link status packet over a communication link 1 3(p) within a predetermined window of time 

4 following receipt of a previous link status packet, and if other types of packets have not been 

5 received in the meantime, the respective switching node 1 l(n) or device 12(m) can determine that 

6 the communication link 1 3(p) has failed or otherwise malfunctioned. If a communication link 1 3(p) 

7 is a uni-directional communication link, in which packets are transferred from one switching node 

8 1 1 (n) to another switching node 1 1 (n 1 ) (n'*n), but not from switching node 1 1 (n') to switching node 

9 1 1 (n), link status packets can still be used to verify that the communication link 1 3(p) has not failed 
^1 0 or otherwise malfunctioned. In that case, the switching node 1 1 (n) can transfer link status packets 
jDl 1 over the communication link 13(p), and the switching node 1 l(n*) can either notify the switching 
Ml 2 node 1 1 (n) that it (that is, switching node 1 1 (n f )) has, or has not, received the link status packet over 
^-1 3 another path therebetween through the network, which path may extent through another switching 
i~14 node 1 l(n") (n"*n\ n). Other mechanisms by which the switching nodes and devices can determine 
^ 15 whether a communication link 13(p) is operating properly, or whether it has failed or otherwise 
\jl 6 malfunctioned, including, for example, mechanisms include detecting the loss of physical signal on 
Ul 7 the communication link or mechanisms similar to those which are implemented in a network 

constructed using the well-known SONET, SDH and TDM protocols, will be apparent to those 

19 skilled in the art. 

20 As noted above, The invention provides an arrangement for facilitating recovering from 

21 failures or other malfunctions in connection with a communication link 1 3(p) interconnecting two 

22 switching nodes 1 l(n). In the first embodiment, in which the network 10 transfers packets in a 

23 connectionless manner, each switching node 1 l(n) establishes, for each communication link 13(p) 

24 which interconnects it (that is, the switching node ll(n)) and another switching node 11 (n'), a 

25 permanent, pre-established special-purpose "bypass" virtual circuit which bypasses the 

26 communication link, over which the switching node 1 l(n) can transfer packets in the event of a 

27 failure or other malfunction in connection with the communication link 13(p). Thus, if a 
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1 communication link 1 3(p) fails or otherwise malfunctions, and if the switching node 1 1 (n) receives 

2 a packet which its routing table indicates would be properly transferred over that communication link 

3 1 3(p), instead of discarding the packet or routing it in a connectionless manner to another switching 

4 node ll(n") (which may result in the other switching node 11 (n') returning the packet to the 

5 switching node 1 l(n)), the switching node 1 l(n) embeds the packet in one or more virtual circuit 

6 packets and transfers it over the pre-established bypass virtual circuit to the switching node 1 1 (n'). 

7 When the switching node 1 1 (n') receives the virtual circuit packet(s) from the switching node 1 1 (n) 

8 over the bypass virtual circuit, it will extract the original packet from the virtual circuit packet(s) and 

9 forward it toward the destination device 12(mD) in the usual manner. 

^10 As a specific illustration, suppose the switching node 11(1) receives a packet (from, for 

M l 1 example, the device 12(1)), for transfer to the device 12(2). Suppose further that the routing table 

^12 of switching node 11(1) indicates that packets to be transferred to device 12(2) are to be transferred 

^13 thereby (that is, by switching node 11(1)) over communication link 13(10) to switching node 1 1(2)), 

H44 but that that communication link 13(10) has failed or otherwise malfunctioned. Finally, suppose that 

pi 5 the switching nodes 1 1 ( 1 ) and 1 1 (2) have established a bypass virtual circuit through switching node 

^16 11 (3), including communication links 1 3(9) and 1 3( 1 1 ). In that case, the switching node 11(1), after 

Cl 7 receiving the packet for transfer to the device 12(2), will embed the packet in one or more virtual 

fol 8 circuit packets for transfer over the bypass virtual circuit, and will transfer the virtual circuit packets 

1 9 over the communication link 1 3(9) to switching node 1 1 (3). The switching node 1 1 (3), as it receives 

20 the virtual circuit packets, will forward them to the switching node 1 1 (2) over communication link 

21 13(11). The switching node 11(2) will reconstruct the original packet from the virtual circuit 

22 packet(s) either as it receives the virtual circuit packets or after it has received all of them. In any 

23 case, after the switching node 1 1(2) has constructed the original packet, it will forward the packet 

24 to its intended destination, in this case device 12(2). 

25 Similar operations can occur in connection with, for example, packets received by switching 

26 node 1 1(1) for transfer to device 12(3) or 12(4), connected to switching node 1 1(4), if its (that is, 

27 switching node ll(l)'s) routing table indicates that such packets are to be transferred over 
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1 communication link 13(10) and through switching node 1 1 (2), and if communication link 13(10) has 

2 failed or otherwise malfunctioned. Thus, if the switching node 1 1(1) receives a packet for transfer 

3 to device 12(3), and if communication link 13(10) has failed or otherwise malfunctioned, the 

4 switching node 11(1), after receiving the packet, will embed the packet in one or more virtual circuit 

5 packets for transfer over the bypass virtual circuit, and will transfer the virtual circuit packets over 

6 the communication link 1 3(9) to switching node 1 1 (3). The switching node 1 1 (3), as it receives the 

7 virtual circuit packets, will forward them to the switching node 11(2) over communication link 

8 13(11). The switching node 11(2) will reconstruct the original packet from the virtual circuit 

9 packet(s) either as it receives the virtual circuit packets or after it has received all of them. In any 
^10 case, after the switching node 1 1(2) has constructed the original packet, it will forward the packet 
=nl 1 to switching node 1 1 (4). The switching node 1 1 (4), after it receives the original packet, can forward 
L12 it to the device 12(4) as destination. 

t:l 3 Bypass virtual circuits can be established in network 1 0 for each communication link 1 3(p) 

Ml 4 in a similar manner. If a communication link 13(p) is a uni-directional communication link, the 

qI 5 respective bypass virtual circuit therefor can be a uni-directional bypass virtual circuit. On the other 

^16 hand, if a communication link 13(p) is a bi-directional communication link, the respective bypass 

Ol 7 virtual circuit therefor can be a bi-directional bypass virtual circuit, or alternatively the switching 

g,18 nodes 1 l(n), 1 l(n') can establish two uni-directional bypass virtual circuits therefor. The virtual 

19 circuits can be established to transfer virtual circuit packets in accordance with any connection- 

20 oriented packet transfer methodology, such as MPLS, ATM, or the like. 

21 As noted above, each switching node ll(n) includes a network topology database, from 

22 which it determines route information to be used in routing packets over the communication links 

23 13(p) connected thereto. The switching nodes ll(n) can establish and update information in the 

24 network topology database in a conventional manner by broadcasting link state advertising messages 

25 through the network 10. Each link state advertising message identifies the switching node 1 l(n), 

26 the communication links 13(p) connected thereto, and the communication cost information that is 

27 applicable to each of the communication links 1 3(p). After a switching node 1 1 (n) receives a link 
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1 state advertising message, it will determine whether the link state advertising message indicates that 

2 the network topology has changed sufficiently to warrant updating the route information which it 

3 maintains in its routing tables, and, if so, will update the route information. If a communication link 

4 13(p) fails or otherwise malfunctions, if the switching nodes ll(n), 11 (n 1 ) connected thereto 

5 broadcast link state advertising messages over the network so indicating, since the link state 

6 advertising messages will be received by the other switching nodes and processed at different times, 

7 their network topology databases and routing tables will generally be inconsistent with each other 

8 for at least some time following the determination that the communication link 13(p) has failed or 

9 otherwise malfunctioned. It will be appreciated that, by use of the bypass virtual circuits, the 
C1 10 switching nodes 1 l(n), 1 l(n') may avoid the necessity of notifying the other switching nodes that 
jfil 1 the communication link has failed or otherwise malfunctioned. Alternatively, the switching nodes 
Ml 2 1 l(n), 1 l(n') may provide a notification that the communication cost related to transfers over the 
J13 virtual circuit has increased, particularly if the total communication cost related to the 
!~14 communication links forming the path of the bypass virtual circuit is higher than that for the 
^15 communication link which has failed or otherwise malfunctioned and is bypassed by the respective 
Q 6 bypass virtual circuit. 

^1 7 The embodiment described above allows the network to operate correctly even in the event 

El 8 of a failure of a communication link 1 3(p), and therefore eliminates the need to immediately notify 

19 all of the switching nodes 1 l(n) in the event of a link failure. Such a notification ensures that the 

20 network will relatively rapidly converge on correct routes which take the link failure into account. 

21 However, in a connectionless network using conventional prior art routing methods, such 

22 notification also ensures that there will be a short period of time during which the switching nodes 

23 ll(n) have an inconsistent view of the topology of the network, potentially resulting in looping 

24 packets, lost packets, or other network disruption. However, in some cases it might be desirable to 

25 provide a notification to the other switching nodes that a communication link has failed or otherwise 

26 malfunctioned so that the other switching nodes can update their network topology databases and 

27 route information accordingly. In that case, the switching nodes 1 l(n), 1 l(n') can, for example, 
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1 (i) notify a network manager, who can determine the cause of the failure or malfunction, and 

2 whether recovery will require enough time to warrant updating the network topology databases and 

3 route information generally throughout the network. If the network manager determines that the 

4 recovery can be performed quickly enough that updates are not warranted, he or she may merely 

5 proceed with the recovery, without enabling updates to the network topology databases or route 

6 information. On the other hand, if the network manager determines that the recovery can not be 

7 performed quickly enough that updates are not warranted, he or she may, in addition to proceeding 

8 with the recovery, enable updates to the network topology databases of the respective switching 

9 nodes; in that case, if the switching nodes can determine whether the update warrants updating the 
^1 0 route information in their respective routing tables and, if so, perform the updates. 

W 1 00 generate link state advertising messages for broadcast through the network, but specify 

y 1 2 that the switching nodes only update the route information in their routing tables at a predetermined 

3 point in time. The predetermined point in time may be selected so as to guarantee that the network 

^14 10 is not busy. Since all of the switching nodes will apply the update at the predetermined point in 

pl 5 time, their routing tables will not be inconsistent. 

p 6 Oii) initially broadcast link state advertising messages which do not indicate that the 

^1 7 communication link has failed or otherwise malfunctioned, but instead that the communication cost 

1 8 associated therewith has increased by a selected small amount. After an amount of time, which is 

1 9 selected to be at least the amount of time required for the last switching node to receive the link state 

20 advertising message, the switching nodes 1 l(n), 1 l(n') will again broadcast link state advertising 

21 messages for which the communication cost associated with the communication link is similarly 

22 increased. As the other switching nodes receive the link state advertising messages, they will update 

23 their routing tables as warranted by the increased communication cost for the respective 

24 communication link. These operations will be repeated through a plurality of iterations until, 

25 eventually, the communication cost has reached a level such that no network traffic is computed 

26 (using the OSPF methodology, as described above) to use that communication link. At that point, 

27 the switching nodes 1 l(n), 1 l(n ! ) can broadcast link state advertising messages indicating that the 
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1 communication link has failed. 

2 It will be appreciated that, after a communication link 1 3(p) has failed or otherwise malfunctioned, 

3 and the bypass virtual circuit used in substitution therefor, the communication cost associated with 

4 the communication link 13(p), and with the communication links 13(p'), 13(p M ) (p\ p'Vp) which are 

5 used for the bypass virtual circuit, can be advertised in the link state advertising messages as having 

6 increased, since there will be increased congestion associated therewith. The other switching nodes 

7 can use the increased communication cost as warranted in updating their route information, which 

8 can help balance the traffic across communication links in the network. After the communication 

9 link 13(p) has been repaired, the link state advertising messages can indicate a corresponding 
;glO reduction in communication cost associated therewith and with the communication links 13(p'), 
fjll 13(p") used for the bypass virtual circuit, and the other switching nodes can use the decreased 
w 1 2 communication cost as warranted in updating their route information, which can restore the network 
=ybl3 to its previous traffic condition. 

JL 14 If there are widespread failures or more than one simultaneous failure, causing a link to fail 

'HI 5 at the same time that the associated bypass virtual circuit or circuits, it will generally be desirable 

pi 6 to provide notifications to the various switching nodes 1 l(n) using conventional routing protocol 

5;17 mechanisms. 

1 8 With this background, operations performed by a switching node 1 l(n) in connection with 

19 this aspect of the invention will be described in connection with FIG. 2. With reference to FIG. 2, 

20 the switching node 1 l(n) performs a plurality of operations to establish bypass virtual circuits for 

2 1 each of the communication links 1 3(p) interconnecting it (that is, the switching node 1 1 (n)) and other 

22 switching nodes 1 l(n'), 1 l(n"),..., in the network 10. In that operation, the switching node 1 l(n) will 

23 determine whether it is connected to a communication link 1 3(p) for which no bypass virtual circuit 

24 exists (step 100). If the switching node 1 l(n) makes a positive determination in step 100), it will 

25 identify the other switching node 11 (ri\ 11 (n"),... that is connected to that communication link 13(p) 

26 (step 101), and identify a path through the network to that other switching node (step 102). The 
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1 switching node ll(n) can use any conventional methodology for identifying a path through the 

2 network to the other switching node in step 102, including the OSPF methodology. After the 

3 switching node 1 1 (n) has identified the path, it will enable the bypass virtual circuit to be established 

4 over the identified path (step 1 03). In that operation, any conventional virtual circuit establishment 

5 methodology can be used to establish the bypass virtual circuit. However, in connection therewith, 

6 at least the switching node 1 1 (n) and the other switching node to which the bypass virtual circuit is 

7 being established will be aware that the virtual circuit is a bypass virtual circuit, so that they will, 

8 when a packet is received for transfer over the communication link 1 3(p), if the communication link 

9 has failed or otherwise malfunctioned, instead of transferring the packet over the communication link 
_10 13(p), embed the packet in one or more virtual circuit packets, transfer the virtual circuit packets 
tfjl 1 over the bypass virtual circuit, and extract the original packet therefrom for transfer to the 
^12 destination. In any case, following step 103, the switching node 1 l(n) will return to step 100, and 
jpl3 repeat steps 100 through 103 through one or more iterations until a bypass virtual circuit has been 
pi 4 established for each communication link connected thereto, after which it can exit (step 104). 

pi 5 After the bypass virtual circuit has been established for a communication link 13(p), the 

jjl 6 switching node 1 1 (n) and other switching node connected thereto can use if in the case of a failure 

y 7 or other malfunction of the communication link 1 3(p). In that connection, when the switching node 

gil8 1 l(n) receives a packet for transfer over the communication link 13(p) (step 110), it will initially 

19 determine whether the communication link 13(p) is operational (step 111). If the switching node 

20 1 1 (n) makes a positive determination in step 1 1 1 , it will transfer the packet over the communication 

2 1 link 1 3(p) (step 112). On the other hand, if the switching node 1 1 (n) makes a negative determination 

22 in step 111, which will occur if the communication link 1 3(p) has failed or otherwise malfunctioned, 

23 it will embed the packet in one or more virtual circuit packets (step 113) and transfer it or them over 

24 the bypass virtual circuit (step 114). When the other switching node receives the virtual circuit 

25 packets, it will extract the original packet therefrom (step 115). Following step 1 12 or step 1 15, the 

26 other switching node will transfer the packet (that is, the original packet) toward its intended 

27 destination (step 1 16). 



IRB-002 

-14- 

1 As noted above, in connection with a second embodiment, in which the network 1 0 transfers 

2 packets in a connection-oriented manner, packets are normally transferred through the network using 

3 constructs such as virtual circuits. In that embodiment, each packet, instead of providing a 

4 destination identifier identifying the actual destination for the packet, provides a virtual circuit 

5 identifier which the switching node that receives the packet uses to identify the communication link 

6 over which the packet is to be transferred, using information from a virtual circuit table. In any case, 

7 in the second embodiment, switching nodes 1 1 (n) comprising the network 1 0 also establish bypass 

8 virtual circuits which they use if a communication link 13(p) fails or otherwise malfunctions, in 

9 connection with transfer of packets for virtual circuits for which the communication link 1 3(p) forms 
_10 part of the path. However, in the case of the second embodiment, the switching nodes ll(n) 
y3l 1 establish either 

y 12 (i) establish a bypass virtual circuit for each virtual circuit for which the communication link 

]jrl 3 forms part of the path, which will be used in connection with packets associated with the respective 

H 14 virtual circuit if the communication link 13(p) fails or otherwise malfunctions, or 

5 (ii) establish one or several virtual circuits over which virtual circuit packets associate with 

p 6 some subset of the virtual circuit(s) for which the communication link forms part of the path, which 

yQl 7 will be used in connection with packets associated with virtual circuit(s) in the respective subset, if 

"18 the communication link fails or otherwise malfunctions. 

1 9 It will be appreciated that item (ii) above will find utility primarily in connection with virtual circuit 

20 transfer methodologies which allow packets from multiple virtual circuits to be merged into a single 

21 virtual circuit for transfer. In connection with either item (i) or item (ii), it will be appreciated that 

22 the bypass virtual circuit established by one switching node 1 1 (n) need not terminate at the switching 

23 node 1 l(n') connected to the communication link, but instead may terminate at another switching 

24 node 1 1 (n") downstream thereof along the path for the virtual circuit, if, for example, the switching 

25 node 1 l(n) determines that that will enhance efficient transfer of packets along the virtual circuit. 

26 In either case, when a switching node 1 l(n) receives a packet associated with a virtual 
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1 circuit for which a communication link 1 3(p) which has failed or otherwise malfunctioned forms part 

2 of the path, it (that is, the switching node 1 l(n), will transfer the packet over the bypass virtual 

3 circuit, in a manner similar to that described above in connection with the connectionless transfer 

4 methodology. Similarly, when the switching node which forms the destination end of the bypass 

5 virtual circuit receives a packet therefrom, it will resume transfer of the packet over the virtual circuit 

6 (that is, the virtual circuit whose path included the communication link 13(p) which had failed or 

7 otherwise malfunctioned. 

8 The invention provides a number of advantages. In particular, the invention provides for the 

9 rapid recovery in connection with transfer of packets through a network in the event of a failure or 
^ 1 0 other malfunction in connection with a communication links, while minimizing problems that can 
ull occur if the network topology information and routing information maintained by the respective 
5^12 switching nodes comprising the network is inconsistent. 

^ y 13 It will be appreciated that numerous modifications may be made to the invention. For 

s 14 example, although the invention has been described as making use of virtual circuits to provide the 

Ql 5 mechanism for bypassing a communication link which has failed or otherwise malfunctioned, it will 

p6 be appreciated that other arrangements, such as source routing, in which the switching node 1 l(n) 

-111 7 connected to a communication link which has failed or otherwise malfunctioned determines the route 

""18 to the other switching node 1 l(n') through one or more other switching nodes. In that case, the 

19 switching node 1 l(n) would embed the packet in a source-routed packet for transfer to the other 

20 switching node 1 1 (n f ). The switching node 1 1 (n') ? when it receives the source-routed packet, extracts 

21 the original packet for transfer towards the destination. 

22 In addition, it will be appreciated that any convenient virtual circuit transfer methodology 

23 can be used, including ATM, MPLS, etc., for use in connection with bypass virtual circuits. 

24 In addition, although the invention has been described in connection with providing a bypass 

25 virtual circuit for use in the event of failure of a communication link 1 3(p), it will be appreciated that 

26 bypass virtual circuits can similarly be established to bypass other components, including, for 
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1 example, a switching node, in the event of a failure or other malfunction of the switching node. For 

2 example, with reference to FIG. 1 , if switching node 1 1 (2) wishes to establish abypass virtual circuit 

3 to be used in the event of a failure of switching node 1 1 (3) for transfer of packets to switching node 

4 1 1 (6), it can establish a bypass virtual circuit to node 1 1 (6) through switching node 11(1). Thus, if 

5 switching node 1 1 (2) determines that switching node 1 1 (3) has failed or otherwise malfunctioned, 

6 it will transfer packets to switching node 1 1(6) over that bypass virtual circuit as described above. 

7 Bypass virtual circuits for use in the event a switching node 1 l(n) fails or otherwise malfunctions 

8 may be established either instead of or in addition to the bypass virtual circuits established for use 

9 in the event of a failure or other malfunction of a communication link 1 3(p). 

^10 It should be noted that, in general it may be difficult to rapidly determine whether a 

Mil communication link 13(p) or switching node ll(n) has failed or otherwise malfunctioned, 

y 12 particularly if such determination requires transfer of packets through other switching nodes. For 

J13 example, with reference to FIG. 1, if switching node 11(2) detects a failure in connection with 

HI 4 communication link 13(1 1), the switching node 1 1(2) will not be immediately able to determine 

pi 5 whether the communication link 13(p) itself has failed or whether the switching node 11(3) 

^16 connected thereto has failed. However, bypass virtual circuits can be set up to other nodes in the 

Ol7 network which bypass multiple network components, such that the failure can be bypassed 

ml 8 regardless of which if the network components has failed. 

1 9 Furthermore, it will be appreciated that bypass virtual circuits can be established in a network 

20 for all, or any subset of communication links and/or switching nodes in the network. 

2 1 In addition, it will be appreciated that the invention can be used in connection with networks 

22 carrying any type of digital data, including voice or video data, as well as data for use in digital 

23 processing. 

24 In addition, although the switching nodes 1 l(n) have been described as being similar to the 

25 switching node described in the aforementioned Schwartz, et al., application, it will be appreciated 

26 that the invention may be used in connection with switching nodes of any structure or architecture. 
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1 It will be appreciated that a system in accordance with the invention can be constructed in 

2 whole or in part from special purpose hardware or a general purpose computer system, or any 

3 combination thereof, any portion of which may be controlled by a suitable program. Any program 

4 may in whole or in part comprise part of or be stored on the system in a conventional manner, or it 

5 may in whole or in part be provided in to the system over a network or other mechanism for 

6 transferring information in a conventional manner. In addition, it will be appreciated that the system 

7 may be operated and/or otherwise controlled by means of information provided by an operator using 

8 operator input elements (not shown) which may be connected directly to the system or which may 

9 transfer the information to the system over a network or other mechanism for transferring 

10 information in a conventional manner. 

1 1 The foregoing description has been limited to specific embodiments of this invention. It will 

1 2 be apparent, however, that various variations and modifications may be made to the invention, with 

13 the attainment of some or all of the advantages of the invention. It is the object of the appended 

14 claims to cover these and such other variations and modifications as come within the true spirit and 

1 5 scope of the invention. 
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What is claimed as new and desired to be secured by Letters Patent of the United States is: 
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Claims 



1 1 . A network comprising a plurality of switching nodes interconnected by communication links, the 

2 switching nodes transferring digital data packets thereamong over said communication links, 

3 A. at least one switching node in the network pre-establishing a bypass virtual circuit through 

4 the network through at least one other switching node in the network and over respective 

5 ones of said communication links to define a path through said network that bypasses at least 

6 one of said communication links connected to said at least one switching node and another 

7 switching node which is also connected to said at least one of said communication links ? 

8 B. the at least one switching node transferring ones of said digital packets, which it would 

9 otherwise transfer to the another switching node, over the bypass virtual circuit in the event 

10 of a malfunction of the respective at least one of said communication links and said another 

1 1 switching node. 



1 
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2 A network comprises a plurality of switching nodes interconnected by communication links 

3 for transferring digital packets. At least one switching node in the network pre-establishes a bypass 

4 virtual circuit through the network to bypass an element of the network, such as a switching node 

5 or a communication link, in the network. The bypass virtual circuit defines a path to another 

6 switching node in the network. The first switching node uses the bypass virtual circuit so 

7 constructed in forwarding of a packet in the event of a failure or other malfunction of the element 

8 if the first switching node would otherwise transfer the packet over that element. 
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101. SWITCHING NODE 11(n) IDENTIFIES THE OTHER 
SWITCHING NODE THAT IS CONNECTED TO THAT 
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110. SWITCHING NODE 11(n) RECEIVES A PACKET FOR 
TRANSFER OVER COMMUNICATION LINK 13(p) 



111. SWITCHING NODE 11(n) DETERMINES WHETHER THE 
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112. SWITCHING NODE 11(n) TRANSFERS THE PACKET 
OVER THE COMMUNICATION LINK 13(p) 
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113. SWITCHING NODE 11(n) EMBEDS THE PACKET IN 
ONE OR MORE VIRTUAL CIRCUIT PACKETS 
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114. SWITCHING NODE 11(n) TRANSFERS THE VIRTUAL 
CIRCUIT PACKET(S) OVER THE BYPASS VIRTUAL CIRCUIT 



115. OTHER SWITCHING NODE, AFTER RECEIPT OF THE 
VIRTUAL CIRCUIT PACKETS, EXTRACTS THE ORIGINAL 
PACKET THEREFROM 
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116. OTHER SWITCHING NODE TRANSFERS THE PACKET 
(THAT IS, THE ORIGINAL PACKET) TOWARD ITS 
INTENDED DESTINATION 
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